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(54) Mobile phone using tactile icons 

(57) A mobile phone or telecommunications termi- 
nal that sends and receives tactile icons (tactile sensa- 
tion patterns, including vibration patterns) discernible by 
feel to a user of the mobile phone or terminal, indicative 
of a message desired to be communicated between us- 
ers of such a mobile phone or terminal (not information 
concerning the operation of the mobile phone or termi- 
nal). The mobile phone or terminal includes a source 
(100) of tactile sensations (such as a vibratory device) 



that produces a tactile sensation in response to control 
signals issued by a controller (106) when a message 
including a tactile icon is received; the control signals 
are based on Instructions (140) included in the mobile 
phone or terminal on how to interpret a tactile sensation 
pattern. The source of tactile sensations is for example 
an eccentric electric motor, a source of puffs of air, an 
electric signal, a razor-type linear vibrator, a solenoid, 
or a piezoelectric material. 
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Description 

[0001 ] The present invention relates to apparatus and 
a method for producing a tactile sensation to a user 
thereof, and more particularly to cellular or other mobile 
phones and other telecommunications terminals able to 
produce vibrations greater than 0 Hz or other tactile sen- 
sations discemible by the sense of touch or feel to users 
of such mobile phones or telecommunications termi- 
nals. 

[0002] With respect to human-machine interaction, 
mobile phones (using a wireless telephone network) are 
by their very nature a dramatic improvement over land- 
line phones; a mobile phone obviously imposes fewer 
limitations on a user than a landline phone does, ena- 
bling more natural and expressive communication be- 
cause the machine interface is almost not noticed. The 
mobile phone industry strives constantly to make using 
a mobile phone an even more natural and complete 
communication experience. 

[0003] Therefore, many mobile phones today offer 
modes of expression not usually found in landline 
phones. For example, many mobile phones today in- 
clude small video displays and offer communication via 
pictures (for example of cartoon-like drawings or logos) 
and associated text presented on the displays. Thus, the 
sense of sight is engaged by mobile phones. And of 
course mobile phones, like landline phones, also en- 
gage the sense of hearing. 

(0004] NTT DoCoMo has an email service called Pal- 
dto Email. Panasonic has made phones (models 623p 
and 632p) that have a feature called BeatMelody (see 
http://www.mci.panasonic.co.jp/ pcd/623p/beatmelody/ 
index.html , a Japanese language website), which ap- 
parently allows a user to attach simple vibration patterns 
to email. It is believed by the inventors that the Pana- 
sonic phones use the NTT DoCoMo Paldio email serv- 
ice to deliver the vibrations. 

[0005] U.S. Pat. No. 6,028,531 (the *531 patent) to 
Wanderiich for Terminal Units for a Mobile Communica- 
tion System introduces devices that can be used for 
sending and receiving different kinds of vibration pat- 
terns for interpersonal communication; see especially 
column 6, line 52 to column 7, line 44. The '531 patent 
also discloses various types of vibratable devices, in- 
cluding a personal vibrator of the type used on a human 
body with a user engaging portion that may comprise a 
smooth-ended rod, a smooth plug, or a vibratory aper- 
ture. 

[0006] A patent application having serial number 
09/717,862. assigned to the present assignee, with a 
date of priority of Nov. 26, 1 999, having Sami Ronkainen 
as the sole inventor, discloses tactile feedback, using 
vibration, as part of a phone user interface. The disclo- 
sure also introduces a new way of using a vibration mo- 
tor included in nriobUe phones for alerting a user of the 
mobile phone to an incoming call or a message, such 
as a message conveyed by the so-called short message 
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service (SMS). 

[0007] As far as the inventors are aware, the vibrating 
Panasonic mobile phones have only a few different vi- 
bration pattems. which have no logical or associated 

5 meaning. The same is true of the vibrating mobile 
phones disclosed in the '531 patent. The vibrations 
there are mathematically generated by systematically 
varying amplitude, frequency and duration of vibration 
of a vibrator; in addition, the communication of such vi- 

10 bration pattems Is done with paging systems, not with 
smarter (full) mobile communication systems such as 
mobile communication systems according to the Global 
System for Mobile Communications (GSM). 
[0008] In Sami Ronkainen's invention, the vibrations 

f 5 have associated meanings, but the meanings are asso- 
ciated only with the user interface of the mobile phone. 
According to the invention disclosed there, a user can 
choose different vibration pattems for different callers, 
but there is no suggestion of sending vibration pattems 

20 as a means of communicating a message to the user of 
the receiving mobile phone. 

[0009] What is therefore needed in mobile phones, 
besides a way to engage the senses of sight and hear- 
ing, as described above, is also a way to engage the 
25 sense of touch, not simply as it is engaged in holding a 
mobile phone, but as part of the communication experi- 
ence, i.e. in communicating a message to the user of a 
receiving mobile phone. 

[0010] Accordingly, in a first aspect of the invention, 
30 an apparatus is provided including: means for producing 
a tactile sensation for a user of the apparatus in re- 
sponse to a control signal; and a control means, respon- 
sive to a tactile sensation pattern signal and responsive 
to an instructions signal for instructing how to interpret 
35 a tactile sensation pattern, for providing the control sig- 
nal; wherein the tactile sensation is expressive of infor- 
mation intended to be communicated to the user of the 
apparatus and exclusive of infonnation indicating a call 
is waiting to be answered. 
40 [0011] In accord with the first aspect of the invention, 
the apparatus may also include means for providing the 
instructions on how to interpret a tactile sensation pat- 
tern. Further, the apparatus may also include means for 
creating a tactile sensation pattern and at least tampo- 
ns rarily storing the tactile sensation. Moreover, in some 
applications, the means for creating a tactile sensation 
may include: means for composing and editing a tactile 
sensation; a data store for storing a plurality of tactile 
sensation pattems; and means for selecting a tactile 
50 sensation pattern from the data store. Also in some ap- 
plications, the means for creating a tactile sensation 
may include: means for downloading and editing a tac- 
tile sensation; a data store for storing a plurality of tactile 
sensation pattems; and means for selecting a tactile 
55 sensation pattern from the data store. Also further, the 
means for producing a tactile sensation is typically ei- 
ther: an eccentric electric motor, an intermittent source 
of air flow, an electric signal, a razor-type linear vibrator, 
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a solenoid, a piezoelectric material, means for shaking 
a component of the apparatus, means for sliding back 
and forth a component of the apparatus, means for 
opening and closing a flip of the apparatus, or means 
for moving a sliding component back and forth. Also fur- 
ther, the means for producing a tactile sensation may 
be electrically coupled to the control means but may be 
physically attached to the user of the apparatus. 
[001 2] According to a second aspect of the invention, 
a wireless tenminal is provided including an apparatus 
as In the first aspect of the Invention. 
[0013] According to a third aspect of the invention, a 
communication system is provided including a base sta- 
tion and also including a wireless terminal as in the sec- 
ond aspect of the Invention. 

[0014] According to a fourth aspect of the invention, 
a method if provided for use by a wireless terminal, in- 
cluding: a step, responsive to a tactile sensation pattem 
and responsive to instructions on how to interpret a tac- 
tile sensation pattem, of providing a control signal; and 
a step, responsive to the control signal, of producing a 
tactile sensation sensible to a user of the mobile phone; 
wherein the tactile sensation is expressive of informa- 
tion intended to be communicated to the user of the ap- 
paratus and exclusive of information Indicating a call is 
waiting to be answered. 

[0015] Thus, the inventors have taken the mobile 
phone ringing tones ("audible icons") and visual icons/ 
smilies as two modes of message each packed in a 
compact, non-verbal, stylized way and extend the notion 
of compact, non-verbal, stylized message modes to in- 
clude the tactile mode. 

[0016] In contrast with the prior art, the invention en- 
ables the user of a mobile phone to determine the type 
of the vibration (i.e. the vibration pattem) to be commu- 
nicated over the mobile phone. There is in principle no 
restriction on the type of vibration (or tactile icon) that 
can be communicated. A user can choose a tactile icon 
from a menu or create one on the fly. A description of 
the vibration pattem so determined can then be sent via 
a mobile communication system according to various 
paradigms, including SMS, ringing tones, and picture 
messages according to enhanced SI\4S or some other 
bearer service (such as multimedia message service) 
or protocol (such as wireless access protocol). The vi- 
bration pattem being communicated can have but is not 
limited to a logical meaning, or can be a rhythm, or be 
an imitation of the vibratory force that would be caused 
by a bouncing ball. 

[001 7] Users of mobile phones can then of course fur- 
ther enrich their communication experience by combin- 
ing vibration patterns (tactile icons) with text (lexical 
icons), pictures (visual icons), animations (enhanced 
visual icons) or sounds (vibrations in the audible range, 
and as such, audible icons). These various icons/modes 
of messaging, when used in combination, have a syn- 
ergistic effect enriching the communication experience. 
[001 8] Further features and advantages of the inven- 
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tion will become apparent from a consideration of the 
subsequent detailed description of an embodiment 
thereof presented by way of Illustrative example in con- 
nection with accompanying drawings, in which: 

5 

Fig. 1 is a block diagram of a mobile phone accord- 
ing to the invention; 

Fig. 2 is an illustration of a very few of many different 
10 possible vibration pattems of use (tactile icons) ac- 
cording to the Invention; 

Fig. 3 is an illustration of different ways in which a 
vibration pattem of use according to the invention 
IS can vary; and 

Fig. 4 is a flowchart for an example of the invention. 

[0019] In providing a tactile message mode for a mo- 

20 bile phone, the inventors first used the original vibration 
motor in a mobile phone mock-up to create different kind 
of vibration pattems, each such pattem being identified 
as a tactile icon. The inventors performed a user study 
and discovered that such tactile icons (such as different 

25 vibration pattems, but also Including other tactile sen- 
sations discernible by the sense of touch or feel) convey 
meanings and suggest associations for people and be- 
tween people. The inventors determined that tactile 
icons can be sent and received as smart messages in 

30 much the same way as ringing tones and business cards 
are sent and received by mobile phones, and can also 
be sent as an attachment to a text message, a picture 
message, or any other multimedia message. 
[0020] No additional hardware is needed to Imple- 

35 ment tactile icons even in existing mobile phones includ- 
ing an ordinary vibration motor. All that is needed is soft- 
ware to produce the tactile icons and to handle their 
messaging. 

40 New use of the vibrating element of an ordinary mobile 
phone 

[0021] An ordinary mobile phone is equipped with a 
component able to create vibrations, which are conduct- 
's ed to the user via the casing of the mobile phone (when 
the casing is in direct or indirect physical contact with 
the user). Typically the vibrating component Is a small 
eccentric electric motor, i.e. an electric motor having a 
weight mounted on its axis where the center of the mass 
50 of the weight does not lie along the axis of the motor. 
The vibrating component can be any type of vibratable 
device, including for example a linear vibrator and a pi- 
ezoelectric device. 

[0022] According to the invention, such a vibration 
55 motor of an ordinary mobile phone is used to create dif- 
ferent kinds of vibration pattems. 
[0023] Referring now to Fig. 1, an ordinary mobile 
phone includes a vibration motor 100 under the control 
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of a microcontroller 106; the microcontroller controls the 
action of the vibration motor via a DC driver (not shown). 
The vibration motor produces a vibration, used In the 
prior art to give a silent alarm notifying the user of the 
mobile phone of an incoming call or a waiting message. 
Preferably, frequencies between 1 30 Hz and 250 Hz are 
used when producing vibration with a vibration motor. 
According to the invention, such a microcontroller is pro- 
grammed to cause the vibration motor to produce differ- 
ent kinds of vibration patterns (tactile icons), as deter- 
mined by the user of the mobile phone using software 
specially developed for the task of composing tactile 
icons or selecting tactile icons from a menu. The pro- 
gram used by the microcontroller in causing the vibra- 
tions, i.e. the vibration pattern interpreter 140a, is held 
in non-volatile memory 140 in the mobile phone. The 
memory 140 also holds a vibration pattern composer 
program 140b by which a user interfaces with the mobile 
phone to create new tactile icons/ vibrations pattems or 
edit existing tactile icons, stored vibration pattems 140e 
either created by the user (using the composer) or 
downloaded from a service providing tactile icons using 
another stored program, a vibration pattem downloader 
140c, or saved from an already received message bear- 
ing tactile icons, and a vibration pattem selector pro- 
gram 140c enabling a user to select which stored tactile 
icon to communicate as a message using the mobile 
phone. 

[0024] Still refening to Fig. 1 , as indicated above, a 
mobile phone according to the invention need only have 
a vibration motor 100 orother means of producing a tac- 
tile sensation and software means (stored in the mobile 
phone in a memory 1 40) for executing vibration pattems 
(i.e. for interpreting the vibration pattems to the control- 
ler 106 by providing instructions to the controller so that 
the controller can command the vibration motor accord- 
ingly) and for managing vibration patterns (creating 
them, editing them, saving them or downloading them, 
and selecting one or another to communicate), as well 
as a data store of some sort or another for storing vibra- 
tion pattems (in the memory 140). In addition, such a 
mobile phone usually also includes an antenna 102, a 
transceiver 1 04. and a battery 11 6 or an accumulator in 
place of a battery. Instead of either a battery or an ac- 
cumulator, the mobile phone can use as a source of 
power a car battery or. when used in a house, external 
mains power for the house. In addition, the mobile 
phone usually includes a keypad 108. a display 110, a 
microphone 112. and a loudspeaker 114. 
[0025] Referring now to Fig. 2, various vibration pat- 
tems and their associated or logical meaning are illus- 
trated. For each pattem, vibration (at some unspecified 
frequency greater than 0 Hz) as a function of time is in- 
dicated. In the case of imitating the vibratory force that 
would be caused by a bouncing ball as it bounces to a 
standstill, a lower frequency vibration would correspond 
to the bouncing of a larger, heavier ball, such as a bas- 
ketball, and a higher frequency vibration would corre- 
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spend to the bouncing of a smaller, lighter-weight ball, 
such as a ping pong ball or a golf ball. The vibration in- 
dicating an alert is usually generated using simple re- 
peating cycles where the motor is on for about 500 ms 
5 and then off for about 500 ms in each cycle. 

[0026] Vibration pulses of any length can be used for 
building tactile icons. As mentioned, only the duration of 
the on and off periods is indicated In Fig. 2. and other 
parameters, such as frequency and amplitude, could al- 
to so be varied when specifying a vibration pattem/ tactile 
icon. (Although a rotating vibratton motor, strictly speak- 
ing, has a constant amplitude, the frequency of the vi- 
bration can be changed by changing the speed of rota- 
tion, and it turns out that the perceived intensity of vi- 
15 bration is proportional to the rotating speed so in that 
sense the intensity can be changed even for a rotating 
vibration motor.) 

[0027] Referring now to Fig. 3, the different ways vi- 
bration pattems may vary Is indicated, using a coordi- 

20 nate system in which the x-axIs represents time and the 
y-axis represents amplitude (a vibration-producing de- 
vice capable of varying vibration in both amplitude and 
frequency being assumed for illustration). A dashed line 
208 depicts a vibration pattem in which both the ampli- 

25 tude and frequency are constant, the vibration device 
being simply tumed on and off over and over again at 
the desired frequency (at least for a period of time). A 
curve 204 depicts a vibration pattem in which the am- 
plitude is constant but the frequency increases from a 

30 low frequency to a high frequency at the end of the pat- 
tem. A curve 206 depicts a vibration pattem In which 
both amplitude and frequency vary. Finally, a dashed 
line 202 depicts a pattem in which the amplitude in- 
creases, but the frequency remains constant, in this 

35 case the frequency being the rate at which the vibration 
device is tumed on and off. 

[0028] Refemng now to Fig. 4, a flowchart of the in- 
vention is shown as a method for use by a mobile phone 
including a first step 401 in which, in response to a tactile 

40 sensation pattem (which could either have been re- 
ceived by the mobile phone or which could have been 
indicated by an indicator or pointer in a message re- 
ceived by the mobile phone, and indicator or pointer that 
indicates a predetermined tactile sensation pattem 

45 known to the mobile phone), and using instructions on 
how to interpret the tactile sensation pattem, the mobile 
phone converts the tactile sensation pattem into a con- 
trol signal, and then, in a second step 402, based on the 
control signal, the mobile phone produces a tactile sen- 

50 satlon. 

How tactile icons are communicated 

[0029] According to the preferred embodiment, tactile 
55 icons are communicated between mobile phones (or be- 
tween 3 mobile phone and a landline phone) as smart 
messages, in much the same way as ringing tones and 
business cards are communicated today. (Ringing 
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tones are today often downloaded by mobile phone us- 
ers from a web service to personalize the ringing tones 
of their mobile phones.) In other embodiments, tactile 
icons are communicated as an attachment to a text mes- 
sage, a picture message, or some other multimedia 
message. 

[0030] In the prefen^ed embodiment, what is commu- 
nicated as a tactile icon is an on/off pattern, such as in- 
dicated in Fig. 2, at some specified frequency (and pos- 
sibly indicating a variation in amplitude during the pat- 
tem). In some embodiments, however, a tactile icon se- 
lector is all that is communicated, and the receiving mo- 
bile terminal creates the vibration pattern predetermined 
to conrespond to the communicated selector. 
[0031] Of course the source or the receiverof a tactile 
icon may, according to the invention, be a device other 
than a mobile phone, and may be other than a phone at 
all. For example, a tactile icon can be sent with a PC 
and be received with a vibrating mouse. 
[0032] The mobile phones can, but need not be, 
equipped with editor software to compose vibration pat- 
terns. With a composer one could create personal tactile 
icons quickly and send them to his or her closest friends. 
[0033] Different tactile icons can, but need not be, pro- 
vided through mobile network based services. For ex- 
ample, tactile icons could be downloaded from a web 
service, just as ringing tones and logos are downloaded 
today. 

[0034] Tactile icons could also be communicated as 
a game or as an aspect of a game. For example, an 
operator could send a rhythm pattern (non-audible) to a 
customer (who has registered for receiving games) and 
the task would be to guess the song behind the rhythm. 

How tactile icons are converted to actual vibrations 

sensible to users of mobile phones 

[0035] As already mentioned, a tactile icon can be 
translated into actual vibration (at any frequency greater 
than 0 Hz) using an eccentric weight mounted on the 
axis of a motor 100 under the control of a microcontroller 
106 (Fig. 1). Of course a tactile icon actuator can also 
be implemented as other kinds of devices, including for 
example a solenoid or a piezoelectric actuator. In the 
case of a piezoelectric actuator, not only the frequency 
of the vibration but also its amplitude could be varied. 
[0036] The vibration motor or other means for produc- 
ing vibration can be located either in the mobile phone 
as a separate component (as indicated In Fig. 1 ), or in 
the battery 116, or as a separate component attachable 
to the mobile phone, or as a separate component or part 
of a component coupled only electrically to the mobile 
phone (to receive commands from the microcontroller 
106) but physically attached to the user of the mobile 
phone so as to communicate vibration patterns to the 
user, such as a vibratable device (for example, a piezo- 
electric disk) included in a wristband to be worn by a 
user and connected electrically to the controller 106. 



8 

[0037] The invention is also intended to comprehend 
other tactile sensations besides those created by actual 
mechanical vibrations, such as tactile sensations 
caused by puffs of air or tactile sensations caused by a 

5 small electric current (what is called electro-tactile stim- 
ulation, using two electrical contact areas on the skin of 
the user receiving the tactile sensation). As already 
mentioned, low frequency vibrations can also be pro- 
duced by artificially shaking some inside parts of a mo- 

10 bile phone such as the battery, or by moving a compo- 
nent of a mobile phone. Including for example opening 
and closing a flip or by sliding back and forth a compo- 
nent that slides. 

15 Scope of the Invention 

[0038] It is to be understood that the above-described 
arrangements are only illustrative of the application of 
the principles of the present Invention. Numerous mod- 
20 ificatlons and altemative arrangements may be devised 
by those skilled in the art without departing from the 
scope of the present invention, and the appended 
claims are intended to cover such modifications and ar- 
rangements. 

25 

Claims 

1. An apparatus comprising: 

30 

a) means (1 00) for producing a tactile sensation 
for a user of the apparatus in response to a con- 
trol signal; and 

35 b) a control means (1 06). responsive to a tactile 

sensation pattern signal and responsive to an 
instructions signal for instructing how to inter- 
pret a tactile sensation pattern, for providing the 
control signal; 

40 

wherein the tactile sensation is expressive of infor- 
mation intended to be communicated to the user of 
the apparatus and exclusive of information indicat- 
ing a call is waiting to be answered. 

45 

2. An apparatus as in claim 1, further comprising 
means (140a) for providing the instructions on how 
to interpret a tactile sensation pattem. 

50 3. An apparatus as in claim 1 or 2, further comprising 
means (140b 140c 140d 140e) for creating a tactile 
sensation pattem and at least temporarily storing 
the tactile sensation. 

55 4. An apparatus as in claim 3. wherein the means 
(140b 140c 140d 140e) for creating a tactile sensa- 
tion includes: 
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5. 



a) means (140b) for composing and editing a 
tactile sensation; 

b) a data store (140e) for storing a plurality of 
tactile sensation patterns; and 

c) means (140d) for selecting a tactile sensa- 
tion pattern from the data store. 

An apparatus as in claim 3. wherein the means 
(140b 140c 140d 140e) for creating a tactile sensa- 
tion includes: 



10 



wherein the tactile sensation is expressive of Infor- 
mation intended to be communicated to the user of 
the terminal and exclusive of information indicating 
a call is waiting to be answered. 



a) means (140c) for downloading and editing a 
tactile sensation; 



15 



b) a data store (140e) for storing a plurality of 
tactile sensation patterns; and 

c) means (140d) for selecting a tactile sensa- 
tion pattern from the data store. 

6. An apparatus as in any preced ing claim wherein the 
means (100) for producing a tactile sensation is se- 
lected from the group consisting of: an eccentric 
electric motor, an intermittent source of air flow, an 
electric signal, a razor-type linear vibrator, a sole- 
noid, a piezoelectric material, means for shaking a 
component of the apparatus, means for sliding back 
and forth a component of the apparatus, means for 
opening and closing a flip of the apparatus, and 
means for moving a sliding component back and 
forth. 



20 



25 



30 



7. An apparatus as In any preceding claim 3 wherein 
the means for producing a tactile sensation Is elec- 
trically coupled to the control means but is config- 
ured for physical attachment to the user of the ap- 
paratus. 

8. A wireless terminal including an apparatus as 
claimed in any preceding claim. 



35 



40 



9. A communication system including a base station 
and also including an wireless tenminal as claimed 
in claim 8. 



45 



10. A method for use by a wireless terminal, compris- 



ing: 



a) a step (401 ), responsive to a tactile sensa- 
tion pattern and responsive to instructions on 
how to interpret a tactile sensation pattern, of 
providing a control signal; and 

b) a step (402), responsive to the control signal, 
of producing a tactile sensation sensible to a 
user of the terminal; 



50 



55 
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